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VEHICLE INFORMATION AND INTERACTION MANAGEMENT 

CROSS REFERENCE TO RELATED APPLICATIONS 

The present application is a continuation-in-part of Application No. 
10/285,317, filed October 31, 2002, which is herein incorporated by reference in its 
entirety. 

BACKGROUND OF THE INVENTION 

[0001] The present disclosure relates generally to vehicle information and 
interaction management and in particular, to a method of managing message delivery 
and access to vehicle features and functions based on a driving workload estimate. 

[0002] Vehicles, such as automobiles, generally feature one or more displays 
to provide locally obtained information related to a current state of the vehicle. The 
display is positioned within the vehicle such that a driver of the vehicle can view 
information while driving the vehicle. For example, the display can provide 
information on a windshield, a dashboard or a steering wheel. Typically, each display 
contains one or more windows. Locally obtained information, such as the speed of 
the vehicle, the direction traveled by the vehicle, the outside air temperature, whether 
the air conditioner is in use, whether the hazard light is on, fuel status of the vehicle, 
and the like, is provided in these windows. In addition, information collected from 
vehicle sensors can be used to create vehicle status and maintenance messages for 
display in the windows. These messages include information such as "window 
washer fluid low" and "check tire pressure." 

[0003] The current displays in vehicles are capable of providing different 
types of media from a variety of sources. The display provides audio, text, graphic 
images, and/or video (e.g., night vision display). Additionally, the display provides 
information from various databases and remote servers using a wireless network. For 
example, traffic and/or weather alerts is communicated through any of the display 



means mentioned above. In addition, smart advertising is transmitted to the display to 
inform the driver of a nearby restaurant or store. Providing all of these types of 
information and media can be helpful to the driver but providing it without 
considering the current driving situation may result in increased driver workload, 
driver distraction and/or decreased driving performance. 



BRIEF DESCRIPTION OF THE INVENTION 

[0004] One aspect of the present invention is a method for vehicle information 
and interaction management. The method comprises receiving vehicle feature data 
and driver preference data for a vehicle. In addition, the method also comprises 
receiving an information message from the vehicle and a driving workload estimate 
that is indicative of current and previously occurring conditions. A control signal 
responsive to said vehicle feature data, said information message, said driver 
preference data and said driving workload estimate is provided to initiate the 
activation or disablement of a function of the vehicle. 

[0005] In another aspect, a system for vehicle information and interaction 
management comprises a network and a microprocessor in communication with the 
network. The microprocessor includes instructions to implement a method 
comprising receiving vehicle feature data and driver preference data for a vehicle via 
the network. The method also comprises receiving an information message for the 
vehicle via the network. In addition, the method comprises receiving a driving 
workload estimate that is indicative of current and previously occurring conditions. A 
control signal responsive to said vehicle feature data, said information message, said 
driver preference data and said driving workload estimate is provided to initiate the 
activation or disablement of a function of the vehicle. 

[0006] In a further aspect, a computer program product for vehicle 
information and interaction management comprises a storage medium readable by a 
processing circuit and storing instructions for execution by the processing circuit for 
performing a method comprising receiving vehicle feature data and driver preference 
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data for a vehicle. The method also comprises receiving an information message from 
the vehicle and a driving workload estimate that is indicative of current and 
previously occurring conditions. A control signal responsive to said vehicle feature 
data, said information message, said driver preference data and said driving workload 
estimate is provided to initiate the activation or disablement of a function of the 
vehicle. 



BRIEF DESCRIPTION OF THE DRAWINGS 

[0007] Referring to the exemplary drawings wherein like elements are 
numbered alike in the several FIGURES: 

[0008] FIG. 1 is a block diagram of an exemplary system for performing 
vehicle information and interaction management; 

[0009] FIG. 2 is a hierarchical table that may be used by an exemplary 
embodiment of the present invention to determine access to vehicle functions; and 

[0010] FIG. 3 is a table of vehicle status messages including display 
instructions for use by an alternate exemplary embodiment of the present invention. 

DETAILED DESCRIPTION OF THE INVENTION 

[001 1] A method of vehicle information and interaction management is 
presented. Briefly stated, the method weighs the estimated driving workload before 
displaying vehicle status messages and before allowing functions of the vehicle to be 
engaged. A driving workload estimate is input to the vehicle information and 
interaction manager. The driving workload estimate may include one or more inputs 
to represent vehicle and driving conditions. The driving workload estimate reflects 
both current and previously occurring conditions. The driving workload estimate is 
updated on a periodic basis (e.g., every second). Driver preference data and vehicle 
feature data are also input to the vehicle information and interaction manager. The 
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vehicle information and interaction manager processes these inputs and initiates 
actions within the vehicle that affect vehicle messages, features and functions. These 
actions may include the timing of vehicle messages (e.g., message delay, message 
postponement), modification of the message presentation modality, feature or 
function access being disabled and modification of feature or function access. 

[0010] FIG. 1 is a block diagram of an exemplary system for performing 
vehicle information and interaction management. An instantaneous workload 
estimate 104, an intermediate workload estimate 108 and an overall workload 
estimate 106, referred to collectively as a driving workload estimate, are input to a 
vehicle information and interaction manager 102. Also input to the vehicle 
information and interaction manager 102 is driver preference data 1 10 and vehicle 
feature data 1 12. The vehicle information and interaction manager 102 includes 
application code for creating vehicle function interface instructions 1 14, vehicle 
function access instructions 116, vehicle status message display instructions 118 and 
vehicle status message communication instructions 120. 

[001 1] The vehicle information and interaction manager 102 is located at a 
microprocessor (e.g., micro-controller, PLA) contained in the vehicle. The 
microprocessor may be dedicated to performing vehicle information and interaction 
manager 102 functions or, alternatively, the microprocessor may include application 
code for performing other vehicle functions along with the vehicle information and 
interaction manager 102 functions. Storage space for intermediate application results 
as well as application inputs and outputs may be located on the microprocessor or 
located on an external storage device accessible by the microprocessor. In addition, 
the microprocessor may be attached to a network that may provide communication 
internal to the vehicle, or in an alternate embodiment, communication with devices 
that are external to the vehicle as well. 

[0012] The instantaneous workload estimate 104, intermediate workload 
estimate 108 and overall workload estimate 106 are expressed as numeric values and 
reflect relative workload levels. For example, the numeric value may range from one 
to one-hundred and the workload level may be measured relative to a reference state, 
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such as a vehicle that is not moving or a vehicle where the ignition is not engaged. A 
new driving workload estimate is received on a periodic basis from a workload 
estimation system. The instantaneous workload estimate 104 reflects driving 
conditions based on a short time frame (e.g., the preceding zero to three seconds). For 
example, the act of turning the vehicle would have an impact on the instantaneous 
workload because it would add to the current driving workload and because turning is 
generally completed in a few seconds. The intermediate workload estimate 108 
reflects driving conditions based on an intermediate time interval (e.g., the previous 
three seconds to three minutes) and may value the impact of states that continue to 
effect driving conditions or performance even after they are no longer present. For 
example, if the input data indicates that the driver has just completed a merge into 
traffic or exited a braking maneuver where the anti-lock brake system (ABS) was 
activated, the intermediate workload estimate 108 would reflect these events for a 
specified time interval. An event that affects the intermediate workload estimate 108 
includes some recovery time for the driver. The overall workload estimate 106 
reflects driving conditions based on a long term workload or the total workload 
accumulated during an ignition cycle. For example, the length of time that the driver 
has been operating the vehicle may have been factored into the overall workload 
estimate 106. 

[0013] The driver preference data 1 10 may be used to set the level of 
management performed by the vehicle information and interaction manager 102. For 
example, the driver preference data could indicate a request for aggressive 
management, neutral management or minimal management. The neutral management 
could be set to display the "headlamp failed" message at moderate workload levels 
(e.g., three or lower on a five point scale) and an aggressive management setting 
might display the message at a lower workload level (e.g., two or lower on a five 
point scale). Further, a minimal manager might display the message at a higher level 
(e.g., four and lower on a five point scale). In this manner individual differences 
between drivers may be accounted for by the vehicle information and interaction 
manager 102. The vehicle feature data 112 is a list of the various functions provided 
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in the vehicle and is utilized to initialize the vehicle information and interaction 
manager 102 for a particular vehicle. 

[0014] Outputs from the vehicle information and interaction manager 102 
include vehicle function interface instructions 114 and vehicle function access 
instructions 1 16. The vehicle function interface instructions 1 14 are used to activate 
or disable the types of interfaces that are available to particular devices that are 
attached to the vehicle (e.g., installed in the vehicle or part of the vehicle). Examples 
of possible interfaces include keypad and voice activation. The vehicle function 
access instructions 116 are used to activate or to disable particular functions of 
devices that are attached to the vehicle (e.g., installed in the vehicle or part of the 
vehicle). The access instructions may activate access to a particular device or disable 
access to the device. Vehicle status message display instructions 1 18 are used to 
activate or to disable particular vehicle status messages. Vehicle status message 
communication instructions 120 are used to determine the methods of communicating 
vehicle status messages. 

[0015] FIG. 2 is a hierarchical table that may be used by the vehicle 
information and interaction manager 102 in an embodiment of the present invention to 
determine access to vehicle functions. FIG. 2 includes a table 200 of functions and an 
associated maximum workload estimate based on a workload estimate scale of one to 
one-hundred. The maximum workload estimate may be compared to all three 
components of the driving workload estimate or to a subset of the driving workload 
estimate data. Functions include vehicle status messages that may be listed 
individually, grouped together by like function or grouped together as one function, or 
entry, in the table 200. In addition, a function may be a manner of communicating a 
vehicle status message such as voice, standard text, bold text and video. Functions 
may also include access to a device attached to the vehicle or access to particular 
interfaces associated with a device attached to the vehicle. Devices attached to the 
vehicle include devices such as cellular phones, navigation devices, car stereo 
equipment, Internet news devices and electronic mail devices. 
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[0016] For example, the interface to a cellular phone may be managed by the 
vehicle information and interaction manager 102. The driver of the vehicle may only 
have access to the keypad on a cellular phone to dial outgoing phone calls and to 
answer incoming phone calls when the driving workload estimate is low (e.g., less 
than twenty on a scale of one to one-hundred). The driver may have access to the 
voice activated functions of the cellular phone until the driving workload estimate 
gets to a higher level (e.g., sixty on a scale of one to one-hundred). When the driving 
workload estimate reaches a certain level (e.g., sixty or higher on a scale of one to 
one-hundred) any use of the cellular phone may be disabled and the driver of the 
vehicle cannot access any functions associated with the cellular phone. A table, such 
as the one depicted in FIG. 2 may be used to implement these restrictions based on 
driving workload estimates. 

[0017] Still referring to FIG. 2, the "manual composition of e-mail" entry 220 
is associated with a maximum workload estimate of ten. The vehicle information and 
interaction manager 102 would use this information to disable access to manual 
composition of e-mail when the driving workload estimate is higher than ten. The 
"voice directed composition of e-mail" entry 218 is associated with a maximum 
workload estimate of twenty. Therefore, the vehicle information and interaction 
manager 102 would disable access to voice directed composition of e-mail when the 
driving workload estimate is higher than twenty. The "manual interface with cellular 
pad" entry 216 is associated with a maximum workload estimate of thirty. Therefore, 
the vehicle information and interaction manager 102 would disable access to making 
cellular phone calls on key pads when the driving workload estimate is higher than 
thirty. Similarly, the "voice guided server browsing" and "text-to-speech read back of 
e-mail" entries 214 are associated with a maximum workload estimate of forty and 
would be disabled when the driving workload estimate is higher than forty. The 
"navigation map interactions" and "involved telephonic interaction with an automatic 
service center" entries 212 are associated with a maximum workload estimate of fifty 
and would be disabled when the driving workload estimate is higher than fifty. The 
"operationally significant vehicle system status", "navigation point-of-interest 
search/display", "basic telephonic interaction with an automated service center" and 
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"speech interface cellular phone activities" entries 210 are associated with a 
maximum workload estimate of sixty and would be disabled when the driving 
workload estimate is higher than sixty. The "telephonic interaction with operator 
assisted service center" entry 208 is associated with a maximum workload estimate of 
seventy and would be disabled when the driving workload estimate is higher than 
seventy. 

[0018] Also as shown in FIG. 2, the "detailed navigation instructions" entry 
206 is associated with a maximum workload estimate of eighty and would be disabled 
when the driving workload estimate is higher than eighty. Similarly, the "safety 
system status messages", vehicle warning messages" and "navigation tum by turn 
instructions" entries 204 are associated with a maximum workload estimate of ninety 
and would be disabled when the driving workload estimate is higher than ninety. 
Lastly, the "automatic emergency call", "manually generated emergency call", 
"collision avoidance warnings" and "critical safety messages" entries 202 do not have 
a maximum workload level and therefore would never be disabled by the vehicle 
information and interaction manager 102. The functions, groupings and maximum 
workload levels depicted in FIG. 2 are intended to be illustrative of the types of 
functions and associated workload levels that could be implemented using an 
embodiment of the present invention. A typical implementation of the vehicle 
information and interaction manager 102 would include many more functions than 
those illustrated in FIG. 2 and would be tailored for a particular vehicle. The tailoring 
could include different maximum workload levels and the use of a different scale for 
the workload estimates. 

[0019] In an exemplary embodiment of the present invention, each function, 
such as those depicted in FIG. 2, may be associated with a subroutine for determining 
whether to activate or disable the function. The subroutine is part of the vehicle 
information and interaction manager 102 application code. For example, one of the 
functions may be a blinking display of the vehicle status message "low oil." A 
subroutine associated with this function could be called to determine if the blinking 
status message should be displayed. The subroutine could look at the overall 
workload estimate 106 and activate the message, or function, if the overall workload 
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estimate is over a particular value (e.g., seventy on a scale of one to one hundred). 
This could be done because if the overall workload estimate 106 is causing the driving 
workload estimate to be over the threshold, the driving workload estimate might 
remain over the threshold until the ignition is turned off and it might make sense to 
display the message. However, the subroutine may check the instantaneous workload 
estimate 104 and the intermediate workload estimate 108 and disable the "low oil" 
message if one is over a pre-selected threshold and the overall workload estimate 106 
is below a pre-selected threshold. In this way the functions may be activated and 
disabled by analyzing the three components of the driving workload estimate: the 
instantaneous workload estimate 104, the overall workload estimate 106 and the 
intermediate workload estimate 108. 

[0020] In addition, the use of a subroutine may take into account driver 
preference data 110, vehicle data (e.g., wiper status, vehicle speed, oil level data and 
turn signal data), environment data (e.g., outside air temperature and side collision 
warning data) and current condition data (e.g., are radio controls being manipulated) 
to perform further analysis before making a determination about whether a function 
should be disabled or activated. For example, a subroutine may contain logic to 
disable a low washer fluid message if the driving workload estimate is above a pre- 
selected level and the wipers are not currently in use. Another example of using 
additional input is disabling a voice message to warn the driver of an object located 
behind the vehicle until the vehicle is in reverse gear. In this manner, the subroutines 
may be utilized to tailor the vehicle information and interaction manager 102 based on 
implementation requirements and available input data. 

[0021] In an alternate exemplary embodiment of the present invention, an 
information message is input to the vehicle information and interaction manager 102 
along with the driver preference data 1 10, vehicle feature data 1 12 and the driving 
workload estimate (represented as either a single value or as multiple values). The 
alternate exemplary embodiment of the present invention may limit the information 
message(s) from being instantly broadcast to the driver of the vehicle. Vehicle 
information messages are assigned severity levels. Based on the priority of the 
information and the urgency of the message, a message timing and maximum delay is 
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assigned to each message. The vehicle information and interaction manager 102 is 
then capable of presenting the information to the driver of the vehicle according to the 
vehicle driving and condition contexts. 

[0022] The decision to associate a particular priority level with a particular 
information message may be based on several factors such as the condition being 
identified and a determination of what change in vehicle performance results from the 
identified condition. An additional factor may include a determination of whether any 
change is noticeable to the driver of the vehicle without the message being displayed. 
Other factors may be related to importance (e.g. what are the consequences of the 
condition and the lack of action), urgency (how soon must the driver act) and the 
response to the condition (what can/should/must the driver do). Other considerations 
may be taken into account depending on specific implementation requirements. 

[0023] FIG. 3 is a table of vehicle status messages including display 
instructions for use by an alternate exemplary embodiment of the present invention. 
Vehicle messages 302 are classified into display instructions 304 based on their 
priority levels. The first group of vehicle display messages 306 may include 
messages such as engine overheated, breaks not functioning and a collision avoidance 
warning. These messages may correspond to the display immediately display 
instruction 304. This group of messages may refer to the highest level priority 
conditions that threaten the overall integrity of the powertrain systems and/or the 
operation of the moving vehicle. The presence of these conditions would be delivered 
to the driver of the vehicle regardless of the workload estimate. 

[0024] A second group of vehicle status messages 308 depicted in FIG. 3 are 
those that do not indicate an immediate threat to vehicle integrity or operation so that 
their broadcast to the driver may be timed to the overall driving context/environment. 
For example, because a running vehicle's electrical system can continue to operate 
(for some period) without a functional generator, it is not required that the driver be 
informed immediately of this status. However, since continued driving without a 
functioning generator may raise the risk of system failure, a maximum delay of "M" 
minutes may be assigned to this condition. "M" will be assigned a pre-selected value 
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(e.g. 2, 5,) 60 that may vary based on factors such as vehicle type and mileage on 
vehicle. Messages fitting into this category may be at a medium priority level and 
include ABS inoperative, generator not functioning, engine temperature rising and 
low fuel. As depicted in FIG. 3, display of these messages may be delayed for up to 
"M" minutes if the driving workload estimate is above a pre-selected level, denoted as 
"Wl" (e.g., fifty, ten). Alternatively, the display of the messages may be delayed for 
"M" minutes regardless of the driving workload estimate. 

[0025] A third group of vehicle status messages 310 depicted in FIG. 3 
include those that are not deemed to be important or urgent while the vehicle is 
moving. Examples of these low priority level messages may include vehicle 
maintenance reminders such as engine oil change due and tire rotation due. In 
general, these type of messages may not be directly acted upon while driving and are 
programmed to allow for a delayed response from the driver. These messages may be 
held and displayed when the vehicle is not moving or is moving below a pre-selected 
speed. Alternatively, these messages may be held until the vehicle is moving below a 
pre-selected speed, "S" (e.g. 5 mph), and/or the driving workload estimate is below a 
pre-selected level, "W2." In an exemplary embodiment of the present invention, 
"W2" will be a lower workload estimate value than "Wl." 

[0026] Other status vehicle status messages 302 and display instruction 304 
schemes may be implemented in an alternate embodiment of the present invention. 
For example, display instructions 304 may also be based on the values of other data 
available to the vehicle information and interaction manager 102. Example of other 
data that may be available include environmental data (e.g., outside air temperature, 
time of day), current condition data (e.g., phone in use) and vehicle data (e.g., brake 
position). In addition, any combination of vehicle status messages 302 and display 
instructions 304 may be implemented in an alternate embodiment of the present 
invention. In addition, the vehicle status messages 302 are separated into three groups 
in FIG. 3, but any number of vehicle status message 302 groupings may be 
implemented in an alternate embodiment of the present invention. Further, the 
vehicle status message communication instructions 120 may vary based on the display 
instructions 304. 
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[0027] The disclosed invention provides the ability to weigh the estimated 
driving workload before displaying vehicle status messages and before allowing 
functions of devices in the vehicle to be activated. The vehicle information and 
interaction manager 102 may be tailored based on three estimated workload levels, 
based on driver preference data, and based on a variety of vehicle and environment 
inputs. Staging the vehicle status messages presented to the driver may result in 
better communication with the driver and in higher driver satisfaction with the 
vehicle. The driver is not bombarded with every vehicle status message that applies 
at every minute but instead may be presented with vehicle status messages in a 
controlled manner. In addition, the ability to disable particular functions of devices in 
the vehicle from being engaged based on an estimated driving workload and other 
inputs may lead to less distracted drivers. 

[0028] As described above, the embodiments of the invention may be 
embodied in the form of computer-implemented processes and apparatuses for 
practicing those processes. Embodiments of the invention may also be embodied in 
the form of computer program code containing instructions embodied in tangible 
media, such as floppy diskettes, CD-ROMs, hard drives, or any other 
computer-readable storage medium, wherein, when the computer program code is 
loaded into and executed by a computer, the computer becomes an apparatus for 
practicing the invention. An embodiment of the present invention may also be 
embodied in the form of computer program code, for example, whether stored in a 
storage medium, loaded into and/or executed by a computer, or transmitted over some 
transmission medium, such as over electrical wiring or cabling, through fiber optics, 
or via electromagnetic radiation, wherein, when the computer program code is loaded 
into and executed by a computer, the computer becomes an apparatus for practicing 
the invention. When implemented on a general-purpose microprocessor, the computer 
program code segments configure the microprocessor to create specific logic circuits. 

[0029] While the invention has been described with reference to exemplary 
embodiments, it will be understood by those skilled in the art that various changes 
may be made and equivalents may be substituted for elements thereof without 
departing from the scope of the invention. In addition, many modifications may be 
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made to adapt a particular situation or material to the teachings of the invention 
without departing from the essential scope thereof. Therefore, it is intended that the 
invention not be limited to the particular embodiment disclosed as the best mode 
contemplated for carrying out this invention, but that the invention will include all 
embodiments falling within the scope of the appended claims. Moreover, the use of 
the terms first, second, etc. do not denote any order or importance, but rather the 
terms first, second, etc. are used to distinguish one element from another. 
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